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ABSTRACT 



An automatic test apparatus for assuring quality and reli- 
ability of semiconductor integrated circuit devices compris- 
ing a computerized tester controller performing virtual 
timing, formatting, and pattern generation for testing said 
devices; and a test head controlled by the controller, com- 
prising pin electronics, dc subsystem, and support for self- 
testing built into the circuit. The computerized tester con- 
troller comprises pattern sequence control, pattern memory, 
scan memory, timing system and driver signal formatter, 
thereby executing virtually high speed functional tests based 
on test patterns, combined with ac parametric tests of said 
devices. Furthermore, the computerized tester controller 
dynamically transforms data stored in the computer into 
instructions for the test head and into pattern sequence 
matched to the digital function stimulus and response 
required by the design of the devices. 

19 Claims, 6 Drawing Sheets 
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TESTING METHOD AND APPARATUS 
ASSURING SEMICONDUCTOR DEVICE 
QUALITY AND RELIABILITY 

This application claims priority under 35 USC §119(e) 
(1) of Provisional Application No. 60/106,812, filed Nov. 3, 
1998. 

FIELD OF THE INVENTION 

The present invention is related in general to the field of 
semiconductor devices and testing and more specifically to 
a testing methodology assuring device quality and reliability 
without conventional burn -in while using a low-cost tester 
apparatus. 

DESCRIPTION OF THE RELATED ART 

W. Shockley, the inventor of the transistor and Nobel 
prize winner, demonstrated in the late '50s and early '60s the 
effect of fabrication process variations on semiconductor 
device performance; he specifically explored the depen- 
dence of the p-n junction breakdown voltage on local 
statistical variations of the space charge density; see W. 
Shockley, "Problems Related to p-n Junctions in Silicon", 
Solid-State Electronics, vol. 2, pp, 35-67, 1961. 

Since that time, numerous researchers have investigated 
semiconductor integrated circuit (IC) process steps to show 
that each process step has its design window, which in most 
cases follows a Gaussian bell -shaped distribution curve with 
unavoidable statistical tails. These researchers have illumi- 
nated how this statistical variation affects the performance 
characteristics of semiconductor devices, and how to keep 
the processes within a narrow window. The basis for deter- 
mining the process windows was in most cases careful 
modeling of the process steps (such as ion implantation, 
diffusion, oxidation, metallization, junction behavior, effect 
of lattice defects and impurities, ionization, etc.); see for 
example reviews in F. van de Wiele et al., "Process and 
Device Modeling for Integrated Circuit Design", NATO 
Advanced Study Institutes Series, Noordhoff, Leyden, 1977. 
Other modeling studies were addressing the simulation of 
circuits directly; see, for example, U.S. Pat. No. 4,744,084, 
issued May 10, 1988 (Beck et al., "Hardware Modeling 
System and Method for Simulating Portions of Electrical 
Circuits"). 

Today, these relationships are well known to the circuit 
and device designers; they control how process windows 
have to be designed in order to achieve certain performance 
characteristics and device specifications. Based on these 
process parameters, computer simulations are at hand not 
only for specification limits, but within full process capa- 
bility so that IC designs and layouts can be created. These 
"good" designs can be expected to result in "good" circuits 
whenever "good" processes are used in fabrication; device 
quality and reliability are high. Based on testing functional 
performance, computer-based methods have been proposed 
semiconductor device conformance to design requirements. 
See, for example, U.S. Pat. No. 5,668,745 issued Sep. 16, 
1997 (Day, "Method and Apparatus for Testing Semicon- 
ductor Devices"). 

However, when a process is executed during circuit 
manufacturing so that it deviates significantly from the 
center of the window, or when it is marginal, the resulting 
semiconductor device may originally still be within its range 
of electrical specifications, but may have questionable long- 
term reliability. How can this be determined? The traditional 
answer has been the so-called "burn-in" process. This pro- 
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cess is intended to subject the semiconductor device to 
accelerating environmental conditions such that the device 
parameters would show within a few hundred hours what 
would happen in actual operation after about 2 years. 

5 In typical dynamic burn-in, circuit states are exercised 
using stuck- fault vectors. The accelerating conditions 
include elevated temperature (about 140° C.) and elevated 
voltage (Vdd about 1.5xnominal); the initial burn-in is for 6 
hr, the extended burn -in is 2 sets of 72 hr, with tests after 

10 each set. Since 6 hr burn-in is equivalent to 200 k power-on 
hours, device wearout appears early, the reliability bathtub 
curve is shortened, and the effect of defects such as particles 
will be noticed. 

There are several types of defects in ICs, most of which 

15 are introduced during the manufacturing process flow. In the 
last three decades, these defects have been studied exten- 
sively; progress is, for example, reported periodically in the 
Annual Proceedings of the IEEE International Reliability 
Physics Symposium and in the reprints of the Tutorials of 

20 that Symposium. 

In the so-called bathtub curve display, the number of 
failures is plotted versus time. The initial high number of 
failures is due to extrinsic failures, such as particulate 
contamination, and poor process margins. The number of 

25 failures drops sharply to the minimum of intrinsic failures 
and remains at this level for most of the device lifetime. 
After this instantaneous or inherent failure rate, the number 
of failures increases sharply due to wearout mortality 
(irreversible degradation such as metal electromigration, 

30 dielectric degradation, etc.). 

Based on functional tests and non-random yields, auto- 
mated methods have been proposed to analyze defects in IC 
manufacturing and distinguish between random defects and 

35 systematic defects. See, for example, U.S. Pat. No. 5,497, 
381, issued Mar. 5, 1996 (O'Donoghue et al., "Bitstream 
Defect Analysis Method for Integrated Circuits"). 

For burn-in, the devices need facilities equipped with test 
sockets, electrical biasing, elevated temperature provision, 

40 and test equipment. Considering the large population of 
devices to be burned-in, the expense for burn-in is high 
(floor space, utilities, expensive high-speed testers for final 
device test, sockets, etc.). As an example of a proposal to 
avoid burn-in, see J. A. van der Pol et al., "Impact of 

45 Screening of Latent Defects at Electrical Test on the Yield - 
Reliability Relation and Application to Burn-in 
Elimination", 36th Ann. Proc. IEEE IRPS, pp. 370-377, 
1998. It is proposed that voltage stresses, distribution tests 
and Iddq screens are alternatives to burn-in, but the tests 

50 cover only device specification and are thus too limited and 
expensive. 

An additional concern is the effect burn-in has on the 
devices which are subjected to this procedure. After the 
process, many survivors are "walking wounded" which 

55 means that their probable life span may have been shortened 
to an unknown degree. 

In addition to the greatly increased cost for burn-in, the 
last decade has seen an enormous cost increase for automatic 
testing equipment. Modern high-speed testers for ICs cost in 

60 excess of $1 million, approaching S2 million. They also 
consume valuable floor space and require considerable 
installation (cooling) effort. These testers not only have to 
perform the traditional DC parametric device tests, but the 
ever more demanding functional and AC parametric tests. 

65 DC parametric tests measure leakage currents and compare 
input and output voltages, both of which require only modest 
financial investment. Functional tests are based on the test 
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pattern of the device-to-be-tested, a tremendous task for the fabrication process steps, then interpreting these electrical 

rapidly growing complexity of modern ICs. AC parametric data to provide non-electrical characterization of the 

tests measure speed, propagation delay, and signal rise and devices, thereby verifying their compositional and structural 

fall. These tests arc combined to "at speed" functional tests. features, and finally correlating these features with the 

For the required timing control, calibration, and many 5 fabrication process steps to find deviations from the process 

patterns at high speed, the lion share of the financial invest- windows, as well as structural defects, 

ment is needed (between 80 and 95%), Included here are the Th e pvcs&Qi invention can be applied to all logic devices, 

pattern memory and timing for stimulus and response, specifically those made by CMOS technology, such as 

format by combining timing and pattern memory, serial shift wireless products, hard disk drives, digital signal processors, 

registers (scan), and pattern sequence controller. 10 application-specific devices, mixed-signal products, 

Traditional automatic test equipment (ATE) incorporates microprocessors, and general purpose logic devices. It can 

expensive, high performance pattern memory subsystems to also be adapted to Memory products, and expanded to 

deliver complex test patterns during production test of parallel imbedded testing, analog testing, and optimized 

digital ICs. These subsystems are designed to deliver wide JTAG/scan, 

patterns (typically 128 to 1024 bits) at high speeds (typically 15 Based on the we ll-proven premise that good designs result 

20 to 100' s MHz, more than 400 MHz on new devices). The m g00 d products when good manufacturing processes are 

depth of the pattern storage is typically 1 to 64 million. The used? the pre sent invention avoids the traditional method of 

width, speed and depth of the pattern memory requirements, at-speed functional testing and testing of propagation delays, 

along with the sequencing capability (loops, branches, etc.) and ralher tests inslead for so-called process "outliers", both 

combine to significantly affect the cost of the pattern 20 of the systematic and the non-systematic kind. The outlier 

subsystem, to the extent that most pattern subsystems rep- methodology verifies critical process parameters on each 

resent a significant component of the overall ATE cost. cn i Pj sucn ^ voltage box for Vdd, tight Iddq, and leakage 

The traditional pattern memory subsystem limitations are current, as opposed to conventional methodology which 

often the source of test program development problems and verifies electrical specification on each chip for each speci- 

initial design debug inefficiencies. The number of test pat- 25 fied parameter. 

terns required is proportional to the number of transistors in The outlier methodology emphasizes logic testing includ- 
a device. As the device integration rapidly progresses, the i ng testing at-speed built-in self test (BIST), delay fault, 
corresponding test pattern requirements will present increas- I-drive, and wide voltage box. The tester of the present 
ingly difficult challenges for cost effective traditional pattern ^ invention is capable of DC testing, including continuity, 
memory subsystems. leakage current, Iddq, and logic testing, including slow 
In summary, the goal of avoiding the expensive burn-in functional tests, serial scan, algorithmic patterns (for 
procedure and replacing it by a low-cost, fast, reliable and memory devices), delay path fault, and at-speed BIST, 
flexible procedure has remained elusive, until now. An However, the tester of the present invention does not need 
urgent need has, therefore, arisen for a coherent approach to 35 traditional at-speed functional device testing, 
both a low-cost method and a low-cost testing equipment Newer test methodologies, design-for-test (DFT) and 
offering a fundamental solution not only to avoid burn- in, BIST techniques are reducing the need to deliver test pat- 
but to guarantee quality and reliability of semiconductor terns at high speed to several classes of advanced logic 
devices in general, and to achieve these goals with testers of devices. Relaxing traditional at-speed test requirements rep- 
much reduced cost. The method should be flexible enough to 4Q resents an opportunity to significantly reduce the cost of 
be applied for different semiconductor product families and ATE. However, even with reduced pattern speed 
a wide spectrum of design and process variations and should requirements, the depth, width and complexity of the 
lend itself as a guiding tool during wafer fab processing as required pattern sequences can still have a significant impact 
well as after testing at multiprobe and after assembly and on the architecture and cost of the ATE. The invention takes 
packaging. The method and the testers should increase 45 advantage of the potentially lower pattern speed require- 
manufacturing throughput and save floor space, time and mentsof devices compatible with newer test methodologies, 
energy. Preferably, these innovations should break the DFT or BIST techniques, by eliminating the need for a 
stranglehold of cost increases for fast testers which are today traditional pattern memory subsystem, thereby avoiding a 
a significant part of the skyrocketing cost of IC device significant component of ATE cost. 

production, and expedite the time-to-market required for 5Q In one embodiment of the present invention, the 

new IC products. (relatively low cost) workstation or general purpose com- 

SUMMARY OF THE INVENTION puter controllin g , the u tes ' er is . used u as a " virtual " P atter ° 

memory system. In this function, the computer stores and 

The present invention provides a testing method and delivers digital test patterns and thus replaces the 

apparatus assuring IC device quality and reliability by 55 (expensive) pattern sequence controller (pattern memory 

testing yield based on process capability and not yield based sub-system) in traditional testers. The workstation is needed 

on device specifications. With this fundamental change for other tester control functions anyway, so it represents no 

intest methodology, burn-in can be eliminated or reduced to added cost. 

a few percent of the product volume having questionable i n an embodiment of the invention, the tester controller is 

characteristics, and the cost of testers is reduced to about 5% 60 a high performance work station providing user interface, 

of today's high-speed tester cost. The levels of reliability are factory connectivity, as well as tester control. The worksta- 

comparable to six-sigma levels (the six-sigma methodology tion uses "virtual" memory for program and data storage, 

is defined in relation to specifications). Test patterns are stored in the workstation memory as direct 

The method for assuring quality and reliability of IC memory access (DMA) blocks, and transferred to the device 

devices, fabricated by a series of documented process steps, 65 under test (DUT) for digital stimulus and response 

comprises first functionally testing the devices outside their comparison, as needed, during production testing. Although 

specified voltage range, yet within the capabilities of the the pattern data is not transferred "at speed" to the DUT, the 
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use of DMA techniques ensures that the patterns are trans- FIG. 10 illustrates the embodiment of the invention for the 

ferred as efficiently as possible, in order to minimize test VFT to generate a virtual parallel patterns/timing by storing 

time. and executing a stream of direct- access-memory blocks. 

In a specific embodiment of the invention, the pattern bits DETAILED DESCRIPTION OF THE 

stored in the tester controller are executed as a stream of 5 PREFERRED EMBODIMENTS 

DMA blocks in order to generate the traditional parallel ProveQ d cifcuit designs win deliver producl with lhe 

pattern simultaneously applied to the device-under-test. expected performance characteristics if and when the pro- 

Since the workstation's memory is "virtual", the test cesses employed in production are within their defined 
pattern depth is no longer constrained by traditional pattern process windows. However, in real manufacturing, system- 
memory subsystem costs and limitations, avoiding difficult 30 atic and non-systematic process "outliers" may deliver prod- 
cost/limitation tradeoff decisions. uct with questionable quality As defined herein, an "outlier" 

In another embodiment of the invention, only the changes * defined the P? r tioD of the distribution that lies outside 

between patterns have to be stored and loaded. This feature f he ™nnal tevel of variation. An outlier is the value that 
makes pattern storage much more efficient. In contrast, ^ unusually far from the main body of the data. According 

. J-*- i ^ t < r 35 to the invention, outliers are no longer screened by the 

traditional pattern memory systems store all digital mfor- burn . in d but b electrical te * s 

mation tor all pins for each pattern, even though only a small ^ circuit multi robe and 
percentage of the total information changes from pattern to 1 . 1 ^ ' 

pattern. Hiis increases storage requirements and increases A^^probeTest'ing, outliers are detected so that they can 
the amount of ume needed to compile and load pattern 2Q be tQ thre f levels . 

information into the tester. , . 

outlier chips, 

In yet another embodiment of the invention, the worksta- outlier wafer and 

tion capability to create execution flexibility is exploited to outlier wafer lots 

avoid the cost/limitation tradeoff of traditional pattern In FIG ^ the tests performed for finding outlier chips are 

memory systems due to dedicated hardware. 25 tabulated in two sections: The special tests introduced by the 

Conventionally, loops, repeats, branches, subroutines, etc. invention, and additional normal tests adopted by the outlier 

are limited by the architecture and cost of the pattern methodology. The special tests include ultra extreme Vdd 

memory subsystem hardware. In contrast, according to the testS) ] ddq tests, and input leakage tests, 

invention, the pattern sequences are controlled by the work- Special Tests for Identifying Outlier Chips 

station software. The only limit to pattern execution flex- 30 Ultra Extreme Vdd Tests 

ibility is software execution overhead. This overhead, j n CMOS device specifications, Vdd values, the voltage 

however, is generally small with respect to the total pattern supplied to the drain, are typically bracketed by a low and 

execution time in this application. a high value, defining the Vdd voltage box. For example, for 

The technical advances represented by the invention, as a 5 V digital signal processor device, the specification of the 

well as the objects thereof, will become apparent from the 35 Vdd box may be defined by a low value of Vdd min=4.75 V 

following description of the preferred embodiments of the and a high value of Vdd max=5.25 V. According to the 

invention, when considered in conjunction with the accom- invention, however, the detection of outliers requires more 

panying drawings and the novel features set forth in the extreme values: Vdd ult min=3.0 V, Vdd ult max-8.0 V. 

appended claims. These ultra extremes define the Vdd tests for detecting 

40 outliers. 

BRIEF DESCRIPTION OF THE VIEWS OF THE Ultra High Vdd Margin 

DRAWINGS As defined herein, the voltage Vdd and the current Idd 

FIG. 1 lists the tests performed according to the outlier refer t0 * e P° We J in P Ut ° f C^OS devices; Iddq refers to the 

methodology of the invention at IC wafer multiprobe and at ^If cent , or . lea ^ e , curr ? nt ° f draiD ™* Idd " , 

final device probe 45 By a PP 1 > in S the ultra hl S h vdd slress > 11 IS possible to 

„ , /, , „ , , break down marginal transistor oxides or intra/inter-level 

FTC. 2 shows the Vdd outliers as a detail of the Vdd test oxides , thereby creating parasitic mea surable as 

of the invention. Iddq defects cause time-dependent failure mecha- 

FIG. 3 shows the Iddq test and its interpretation within the nisms which can be screened out by measuring Iddq. The 

outlier methodology. 50 type of failures eliminated by this test may be particle 

FIG. 4 summarizes schematically several reliability fail- induced, or may be due to poor intrinsic process margins 

ure mechanisms of multi-level metal IC devices detected by (faults such as filaments or residue), 

the outlier methodology. Consequently, the high Vdd stress test comprises first 

FIG. 5 shows an example of the outlier methodology of applying the ultra high Vdd and then measuring Iddq. In 

the invention as applied to detecting several classes of IC 55 several product families, it was found that approximately 

failures. °f a ^ bum-in failures can be detected by the high Vdd 

nG.6isasimplifiedblockdiagramofth e virtualfunction ?^ r fo,to ^^ anMdq 

tester (VFT), a major embodiment of tbe invention. Ultra Vdd Margin 

_ . , „ . Temperature activated failure mechanisms cannot be 

HG. 7 is an example of a test flow using the VFT and the 60 found b ultra hi h Vdd stress followed by Iddq testing . In 

outlier methodology of the invention. this problem calegory m for instance , marginal via 

FIG. 8 illustrates schematically the interaction of the VFT connections, weak contact, and marginal p-n junctions. 

with the built-in self-test circuit of the device-under-test According to the invention, these potential failure mecha- 

using a high-speed clock. nisms can be found by characterizing the ICs at ultra low 

FIG. 9 illustrates schematically the interaction of the VFT 65 Vdd, categorizing outliers as falling outside "typical low 

with the critical delay path circuit of the device-under-test Vdd" values, and eliminating those statistically suspect 

using a high-speed clock. products. 
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In FIG. 2, the low Vdd outliers 20 are located on the Vdd tests for electrical continuity; 

axis 21 relative to the Vdd specification range 22 and the tests for electrical shorts; 

typical low Vdd process capability 23. The ordinate 24 plots tests f or tne high values of input and output voltage and 

the number of occurrences. Devices having low Vdd values tests for the low values of inpul and output vo ltage; 

in the outlier range 20 arc suspect of reliability problems and 5 low d fu DCtional tests; and 

are, therefore, either to be discarded or subjected to con- * u t t t . . , , . *u * *• ■ 

J low voltage test at high speed, however without timing 

Umescent current Iddq Jests this invention and FIGS. 6, 7 and 8). 

i J / qU1 \1' nt CU " ent Iddq ° f * e d T ™j All of the above tests for identifying outlier chips are 

Idd is plotted (axis 35) as a function of the voltage Vdd ^ . . . . / , . . , «, c .u 

i- I* .u j • c ™*r\c* ■ * / • ,/v ii i 10 low-cost tests (performed by the low-cost apparatus of the 
applied to the drain of CMOS transistors (axis 36). Normal . jf. \ i_ ■ • • ... . 
Iddq curves traces have reference numbers 37. They exhibit ™">n, see below) Chips which have passed the above 
negligible Iddq values up to high Vdd voltages 38. At max ? uthe / tests no lon S er have t0 be burned-in, since experience 
Vdd+0.5 V, max Iddq (39 in FIG. 3) should be computed for has shown lhal the y are guaranteed of good quality and high 
Iddq mean+4 sigma. Typically, max Iddq is between 60 and reliability. Chips which have failed the above outlier tests 
100 piA. 15 are not processed further through the assembly and pack- 
In a static design, as shown in the insert of FIG. 3, of a P ag^g steps, but scrapped as products and submitted to 
transistor 300 and a N transistor 301 in series, whenever failure analysis for identifying the root-cause of the defects 
either one of the transistors is off, there should be no and the manufacturing processes no longer within their 
conductive path between Vdd and Vss; no current Idd should process windows. It is a pivotal advantage of the present 
flow. However, if any current is observed, it is the result of 20 invention that the data of the electrical tests failed can be 
a faulty off-transistor. interpreted to provide non-electrical characterization of the 

During Iddq test, the leakage of all the inverters of a failed circuits, leading to verification of compositional and 

circuit are measured in parallel. This current should be on structural features of the chips. By correlating these features 

the range provided: with the documented fabrication process steps, deviations 

there is no conductive path in the circuit design; 25 from the process windows as well as structural defects can 

no single transistor, when in the off state, draws any be found. 

current. In FIG. 4, a number of electrical and thermomechanical 

What complicates this test are the facts that not all designs defects and reliability failure mechanisms in multi-level 

have a completely non-conductive regime during when in metal ICs are schematically summarized which can be 

the off state, and that in new technologies, which aim at 30 identified using the outlier methodology of the invention. On 

achieving ever higher speed, transistors have become leaky. the left hand side are the electrical failure mechanisms, 

An example of such leaky characteristic is indicated in FIG, mostly caused by electromigration, on the right hand side the 

3 by curve 40, These facts, in turn, drive high Iddq values at thermomechanical failure mechanisms, mostly caused by 

maximum specified Vdd voltage and make it impossible, stresses. In the four levels of metallization, the top metal IV 

therefore, to detect an abnormal leakage path, which is 35 shows electromigration voiding 110 and stress voiding 210. 

generally in the range of a few uA and will thus be just Further, the protective overcoat has a crack 211. Metal III 

"noise" in the 10 to 100 juA of the total Iddq of the device, exhibits a metal side hillock 212, causing shorting between 

In order to remedy this dilemma, the methodology of the line portions of this metallization. Electromigration causes 

invention reduces the voltage Vdd at which Iddq is measured the interlevel shorting 112 from metal III to metal II, 

so that the normal high currents of the transistors are avoided 40 bypassing the via connection 30. Further, the interlevel 

and a tight Iddq limit can be applied. The low Vdd (41 in insulator (oxide) shows crack 213. The via 31 between metal 

FIG. 3) should be selected to have Iddq+4 sigma<l /*A(42 II and metal I suffers from electromigration vias 113. Metal 

in FIG. 3), or other outlier limit. I exhibits metal adhesion problems 215. The contact 32 of 

Furthermore, the Iddq readpoints at high Vdd and low metal I to the moat has a bypass due to contact electromi- 

Vdd are interpolated. They should not fall on a linear curve 45 gration 114. 

through the origin (43 in FIG. 3). However, if they do, then FIG. 5 illustrates an example of the outlier methodology 

a parasitic resistance is indicated which strongly suggests a as applied to detecting IC failures. The voltage activated 

process- related problem. failures are caught by the high voltage Vdd stress explained 

Input Leakage Tests above. The temperature activated mechanisms are caught by 

While device input leakage currents of about 10 are 50 the low voltage Vdd test explained above, instead of 

conventionally specified, the methodology of this invention elevated temperature. 

reduces the acceptable limit to about 70 nA. Devices with Among the high voltage activated failures illustrated in 
substantially higher leakage currents are classified as outli- FIG. 5 are a weak oxide 50 under the polysilicon gate 51 
ers. These devices have to be submitted to parametric tests. causing a high-resistance leakage bypass 52; a weak inter- 
Furthermore, the drive current of transistors in the 55 level oxide 53, affected by a particle 54 and causing a 
on-state ("I-drive") has to be measured, as well as param- leakage current through a high resistance shunt 55; and a 
eters with low Cpk. This number, used for characterizing marginal connection 56 of via 57 between two metal layers 
process capability, compares the actually measured sigma 58, causing increased resistance 59. 
distribution of parameters to the target distribution, espe- Among the low voltage detected failures illustrated in 
cially relative to the centering of the distributions. A value 60 FIG. 5 are a silicon lattice defect, transformed by a hydrogen 
of Cpk- 2 is ideal, values of Cpk<1.5 are suspect of outliers. passivation process step into a high resistance shunt 501 to 
Additional Normal Tests Adopted for Identifying Outlier ground; and a confirmation of the marginal via connection 
Chips 56, caused by electromigration. 

In FIG. 1, the second section of tests performed for Tests for Identifying Outlier Wafers 

finding outlier chips are conventionally performed tests for 65 According to the invention, wafers having too many 

meeting the specifications, which have been adopted by the outlier chips are suspect of poor quality and reliability. As 

outlier methodology of the invention. These tests comprise: mentioned in FIG. 1, specifically wafers with more than 5 to 
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8% Iddq failures (dependent on the device type) have to be 
pulled aside. In addition, whenever the distribution of outlier 
chips on a wafer show peculiarities such as systematic 
distribution, clustering, or unexpected irregularities, the 
wafers are also pulled aside. While the failed chips are 
discarded, the "good" chips are submitted to conventional 
burn-in after assembly and packaging. Furthermore, the 
wafers may be subjected to different temperature, testing and 
assembly programs. 

According to the invention, Iddq data comparisons before 
and after burn-in can reveal a plurality of defects in CMOS 
devices. Among them are high resistance shunts gate to gate, 
poly to poly, poly to N-well, metal to metal layer, source to 
drain, and poly to substrate. The outlier methodology of the 
invention with its sensitive Iddq tests has proven to be a 
successful tool for fabrication process improvements. 
Tests for Identifying Outlier Wafer Lots 

In the summary table of FIG. 1, wafer lots with more than 
about 25% outlier wafers have to undergo burn-in and 
special assembly. The percentage is subject to device type. 
Test for Identifying Assembly Outliers 

As indicated in FIG. 1, the outlier methodology of this 
invention is applied to the continuity, open and shorts tests 
after assembly and packaging. The methodology especially 
identifies bonding processes outside of the process window, 
bonding failures, and wire sweep in the molding process. 

After assembly and packaging of the great majority 
(approximately 95%) of wafers and chips which have passed 
the special tests of the outlier methodology of the invention, 
it is sufficient to test the devices electrically just a single time 
within their operating specifications and at elevated tem- 
perature. It is no longer necessary to submit these devices to 
the burn-in procedure. Further, it is no longer necessary to 
test the devices electrically again at low temperature. 
Obviously, the elimination of these time- and energy- 
consuming procedures saves significant amounts of money 
and failure analysis. 
Virtual Function Tester Apparatus 

An important embodiment of the present invention is the 
virtual function tester (VF1), an apparatus specifically 
designed to implement the outlier methodology of this 
invention. The VTF is shown as a block diagram in FIG. 6. 
Its main parts are 

the test head, consisting of 
pin electronics 60 (interface between tester subsystems 

and device inputs/outputs) 
dc subsystem 61, including 

parametric measurement unit 62 and 
device power supplies 63; and 
programmable high-speed clock 64 supporting BIST 
(built-in self testing); and 

the tester controller 65. 

According to the present invention, controller 65 serves as 
the "virtual" timing, formatting and pattern generating por- 
tion of the tester; controller 65 is a computer (desk top, Sparc 
station) comprising pattern sequence control, pattern 
memory, scan memory, liming system and driver signal 
formatter. Controller 65 thus handles in "virtual" fashion 
those high-speed functions (functional tests based on test 
patterns, combined with ac parametric tests) which cost in 
excess of $1 million in conventional high-speed testers. 

At the present time, the VFT handles devices up to 1024 
pins; performs dc tests including continuity, voltage box 
(Vdd ult min and Vdd ult high), input leakage, and Iddq (240 
p A resolution) tests; further performs slow functional, scan, 
algorithmic, delay fault, and at-speed BIST tests (providing 
speeds of 800 MHz and higher). Should additional tests be 
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required for future device generations, they can be added 
without difficulty, since the controller 65 can be loaded with 
instructions. 

Examples of future VFT capabilities include: Higher pin 
count; parallel testing; analog waveform digitizer and syn- 
thesizer; analog "loop-back" stimulus/capture; MemBIST 
fail capture; and optimized JTAG/scan. 

Based on the VFT apparatus and the outlier methodology 
of the invention, an example of test flow for a silicon 
integrated circuit of the digital signal processor family is 
illustrated in FIG. 7. The test flow is shown at the multiprobe 
test point for the products which will pass each test. In FIG. 
7, after the test 70 for electrical opens and test 71 for 
electrical shorts, the test 72 for ultra low Vdd is performed, 
described above. Devices which fail this test are subjected to 
a lowspeed functional test 73. Then the ultra high Vdd stress 
test 74 is performed, described above. The next test 75 
involves the high frequency clock described above. The next 
test 76 for input leakage is followed by test 77,measuring the 
quiescent current Iddq, described above. Devices 78 which 
pass all these tests can be classified as "good electrical 
chips", GEC. 

In FIG. 8, the interaction of the VFT with the built-in 
self-test circuit of the device-under-test using a program- 
mable high-speed clock 82 is schematically illustrated. In 
this example, the chip, or device, is generally designated 80; 
it comprises the built-in self testing circuit 81 (BIST) as an 
integral part. The BIST generates test patterns internally, 
thus testing the device at its own speed, which, in the 
example of a digital signal processor product, may work at 
800 MHz. 

In FIG. 9, the interaction of the VFT with the critical delay 
path circuit 91 of the device-under-test 90 using a program- 
mable high-speed clock 92 is schematically illustrated. First, 
data 93 is slowly applied to an input test circuit 94. Then, 
fast bursts from clock 92 (for instance, 2 clock cycles) are 
supplied to input circuit 94 and output circuit 95 to check the 
effectiveness of the device critical delay path. 

FIG. 10 gives an example how the test patterns, which are 
stored in the workstation memory as DMA blocks, are 
transferred to the DUT for digital stimulus and response 
comparison during testing. Although the pattern data is not 
transferred "at speed" to the DUT, the use of DMA tech- 
niques ensures that the patterns are transferred as efficiently 
as possible, in order to minimize test time. 

In FIG. 10, the DMA data bus is 16 bits wide and operates 
at 33 MW/s (million words per second). Therefore, all data 
and control during the pattern execution must be transferred 
at 33 MHz via the 16 bit DMA bus. If 256 data bits are 
required to change state (for example, for a 256 pin device), 
at least 16 DMA words would be required for 1 pattern. 
Furthermore, some control overhead is required to direct the 
data bits to the proper device pin groups, and also to 
accommodate pattern changes beyond simple digital states 
(for instance, DUT output masking or bidirectional pin 
control). Therefore, although the DMA transfer rate is 33 
MW/s, the effective pattern rate will be slower because of 
the required data-to-pin mapping and other control. FIG. 10 
shows an example of how a traditional parallel pattern can 
be stored as a 16-bit wide DMA sequence. 

In FIG. 10, the traditional parallel pattern is generally 
designated 100; it is comprised of 64 pins of digital state 
data, arranged in groups of 16 pins, plus control information, 
for 2 pattern cycles 101. The same pattern can be stored and 
executed as a DMA stream, as indicated by 102. The data for 
each pin group is sequentially updated along with control 
information, followed by a synchronization cycle. The syn- 
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chronization cycle is used to update all pattern data simul- 
taneously at the DUT. 

The effective pattern execution rate for this example in 
FIG. 10 would be 33 MHz+6, or 5.5 MHz. This represents 
the worst case, in which some data in all pin groups and 5 
some control information changes between the two patterns. 
In actual practice, typical digital patterns are very redundant. 
Normally only a small percentage of the digital information 
changes from pattern to pattern. In this case, the DMA 
stream needs only to store and apply the changes from 
pattern to pattern, thereby requiring fewer DMA cycles, and 
therefore allowing faster effective pattern rates. 

The pattern execution speed of the VFT is limited. 
Traditionally, pattern execution speed is used to functionally 
test devices "at speed". The test methods used in the VFT 
test strategy generally do not rely on traditional at-speed 35 
functional tests. Device performance is verified using 
at-speed BIST, DFT techniques, internal test structures or 
other parameter measurements that do not require fast 
pattern execution. 

The limited pattern execution speed causes somewhat 20 
extended test time. For a given number of test patterns, the 
test time will be longer if the pattern execution speed is 
slower. However, at-speed test pattern execution generally 
represents a small percentage of the overall test time. 
Furthermore, as workstation speeds and DMA transfer rates 25 
improve, this invention can be scaled for faster test pattern 
execution, without impacting cost. Also, for minor cost 
increases, the width of the DMA data path can be increased, 
resulting in faster pattern execution speed. 

While this invention has been described in reference to 3Q 
illustrative embodiments, this description is not intended to 
be construed in a limiting sense. Various modifications and 
combinations of the illustrative embodiments, as well as 
other embodiments of the invention, will be apparent to 
persons skilled in the art upon reference to the description. 35 
It is therefore intended that the appended claims encompass 
any such modifications or embodiments. 

I claim: 

1. An automatic test apparatus for assuring quality and 
reliability of semiconductor integrated circuit devices com- 4Q 
prising: 

means for dynamically transforming stored instruction 
into a data format suitable for testing said devices; and 

means for sequencing virtual function testing of said 
devices, said sequencing including consecutively test- 45 
ing electrical characteristics of said devices outside 
their specified operating voltage range. 

2. The apparatus according to claim 1 wherein said means 
for virtual function testing is a computer serving as tester 
controller loaded with instructions and acting as a virtual 50 
pattern memory, scan memory, pattern sequence control, 
timing system, and driver signal formatter. 

3. The apparatus according to claim 2 wherein said tester 
controller is a general purpose computer. 

4. The apparatus according to claim 2 wherein said tester S5 
controller stores, programs and executes test programs. 

5. The apparatus according to claim 1 wherein said means 
for transforming stored instruction are test patterns stored as 
direct access memory blocks and transferred to said devices 
for digital stimulus and response comparison during testing. 60 

6. The apparatus of claim 1, further comprising: 
means for supplying power to said semiconductor inte- 
grated circuit devices; and 

wherein said sequencing includes measuring a high volt- 
age quiescent leakage current at a high power supply 65 
voltage higher than a rated maximum operating power 
supply voltage. 



760 Bl 

12 

7. The apparatus of claim 6, wherein: 

a semiconductor integrated circuit device fails if said 
measured high voltage quiescent leakage current 
exceeds a predetermined amount. 

8. The apparatus of claim 1, further comprising: 
means for supplying power to said semiconductor inte- 
grated circuit devices; and 

wherein said sequencing includes measuring a low volt- 
age quiescent leakage current at a low power supply 
voltage lower than a rated minimum operating power 
supply voltage. 

9. The apparatus of claim 8, wherein: 

a semiconductor integrated circuit device fails if said 
measured low voltage quiescent leakage current 
exceeds a predetermined amount. 

10. The apparatus of claim 8, wherein: 

said low power supply voltage is selected whereby a 
quiescent leakage current four sigma above a nominal 
quiescent leakage current is less than 1 ^A. 

11. The apparatus of claim 1, further comprising: 
means for supplying power to said semiconductor inte- 
grated circuit devices; and 

wherein said sequencing includes 

measuring a high voltage quiescent leakage current at 
a high power supply voltage higher than a rated 
maximum operating power supply voltage, 
measuring a low voltage quiescent leakage current at a 
low power supply voltage lower than a rated mini- 
mum operating power supply voltage; and 
a semiconductor integrated circuit device fails if a line 
passing through a first point of said high power supply 
voltage and said measured high voltage quiescent leak- 
age current and a second point of said low power 
supply voltage and said measured low voltage quies- 
cent leakage current passes through the point of zero 
voltage and zero current. 

12. The apparatus of claim 1, wherein: 

said semiconductor integrated circuit device includes a 
test circuit having a input circuit with a data input and 
a clock input, a critical delay path circuit with an input 
connected to the input circuit and an output, and a 
output circuit with an input connected to the output of 
said critical delay path circuit and a clock input; 
said apparatus further includes 

a data circuit supplying said data input of said input 

circuit of said test circuit, 
a clock supplying said clock input of said clock input 
of said input circuit of said test circuit and said clock 
input of said output circuit of said test circuit; and 
said sequencing includes 

supplying data from said data circuit to said input of 

said test circuit and a first slow clock, 
supplying a burst of a second fast clock faster than said 

first slow clock, and 
checking the effectiveness of critical delay path circuit. 

13. The apparatus of claim 12, wherein: 

said burst of said second fast clock consists of 2 clock 
cycles. 

14. A method of testing a semiconductor integrated circuit 
device comprising the step of: 

measuring at least one electrical characteristic of the 
integrated circuit device outside a normal operating 
range of the semiconductor integrated circuit device, 
said step of measuring including 
measuring a high voltage quiescent leakage current at 
a high power supply voltage higher than a rated 
maximum operating power supply voltage; 
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of: 



of: 



failing the semiconductor integrated circuit device if 
said measured high voltage quiescent leakage cur- 
rent exceeds a first predetermined amount; 

measuring a low voltage quiescent leakage current at a 
low power supply voltage lower than a rated mini- 
mum operating power supply voltage; and 

failing the semiconductor integrated circuit device fails 
if said measured low voltage quiescent leakage cur- 
rent exceeds a second predetermined amount. 

15. The method of claim 14, wherein: 

said low power supply voltage is selected whereby a 
quiescent leakage current four sigma above a nominal 
quiescent leakage current is less than 1 //A. 

16. The method of claim 14, further comprising the step 

f: 

failing the semiconductor integrated circuit device if a 
line passing through a first point of said high power 
supply voltage and said measured high voltage quies- 
cent leakage current and a second point of said low 
power supply voltage and said measured low voltage 
quiescent leakage current passes through the point of 
zero voltage and zero current. 

17. The method of claim 14, further comprising the step 
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not performing an extended burn -in test of the semicon- 
ductor integrated circuit device if the semiconductor 
integrated circuit device does not fail. 

18. A method of testing a semiconductor integrated circuit 
device, said semiconductor integrated circuit device includ- 
ing a test circuit having a input circuit with a data input and 
a clock input, a critical delay path circuit with an input 
connected to the input circuit and an output, and a output 
circuit with an input connected to the output of said critical 
delay path circuit and a clock input, said method comprising 
the step of: 

measuring at least one electrical characteristic of the 
integrated circuit device outside a normal operating 
range of the semiconductor integrated circuit device, 
said step of measuring including 
supplying data from a data circuit to said input of said 

test circuit and a first slow clock, 
supplying a burst of a second fast clock faster than said 

first slow clock to said test circuit, and 
checking the effectiveness of critical delay path circuit. 

19. The method of claim 18, wherein: 

said burst of said second fast clock consists of 2 clock 
cycles. 
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